
United States Patent and Trademark Office 



UNITED STATES DEPARTMENT OF COMMERCE 
United States Patent and Trademark Office 
Address: COMMISSIONER FOR PATENTS 
P.O. Box 1450 

Alexandria, Virginia 22313-1450 
www.uspto.gov 



APPLICATION NO. 


FILING DATE 


FIRST NAMED INVENTOR 


ATTORNEY DOCKET NO. 


CONFIRMATION NO. 


09/684,595 


10/05/2000 


Paul Haeberli 


11087-017001 


2363 



7590 



31688 

TRAN & ASSOCIATES 
6768 MEADOW VISTA CT. 
SAN JOSE, CA 95135 



06/23/2004 



EXAMINER 



YANG, RYAN R 



ART UNIT 



PAPER NUMBER 



2672 

DATE MAILED: 06/23/2004 



18 



Please find below and/or attached an Office communication concerning this application or proceeding. 



PTO-90C (Rev. 10/03) 



Office Action Summary 



Application No. 

09/684,595 


Applicant(s) I 
HAEBERLI, PAUL \y 


Examiner 

Ryan R Yang 


Art Unit 

2672 





~ The MAILING DATE of this communication appears on tho cover sheet with the correspondence address — 
Period for Reply 
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DETAILED ACTION 
Continued Examination Under 37 CFR 1.114 

1 . A request for continued examination under 37 CFR 1.114, including the fee set 
forth in 37 CFR 1 .17(e), was filed in this application after final rejection. Since this 
application is eligible for continued examination under 37 CFR 1 .1 14, and the fee set 
forth in 37 CFR 1 .1 7(e) has been timely paid, the finality of the previous Office action 
has been withdrawn pursuant to 37 CFR 1.114. Applicant's submission filed on 
4/5/2004 has been entered. 

2. This action is responsive to communications: Amendment, filed on 4/5/2004. 
This action is non-final. 

3. Claims 1-21 are pending in this application. Claims 1, 12, 16 and 17 are 
independent claims. In the Amendment, filed on 4/5/2004, claims 1, 9, 12, 16 and 17 
were amended. 

4. The present title of the invention is "Previewing a framed image print" as filed 
originally. 

Claim Rejections - 35 USC §103 

5. The text of those sections of Title 35, U.S. Code not included in this action can 
be found in a prior Office action. 

6. Claims 1 -9, 1 1 -1 5, 1 7-1 9 and 21 are rejected under 35 U.S.C. 1 03(a) as being 
unpatentable over Oles (6,047,130) and further in view of Dawson et al. (5,179,638). 
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As per claim 1, Oles discloses a method of generating a frame prototype image 
showing a picture image framed within a frame, the method comprising: 

providing a frame image showing the frame in a perspective view, the frame 
image having a picture portion corresponding to the portion of the frame used to view a 
picture mounted in the frame (Figure 4 26); and 

mapping the picture image to the picture portion of the frame image in order to 
generate the frame prototype image (Figure 3 24 to Figure 4 24). 

Oles discloses a method of generating a frame prototype image. It is noted that 
Oles does not explicitly disclose using texture mapping the picture image of the frame 
image to generate the frame prototype image, however, this is known in the art as 
taught by Dawson et al., hereinafter Dawson. Dawson discloses a method of providing a 
texture mapped perspective view for digital map systems (column 2, line 61-62, since 
the digital map is a prototype image). 

It is further noted that Oles does not explicitly disclose "modifying a texture value 
at a pixel by the original pixel value of the picture image to generate the frame prototype 
image", however, however, this is also known in the art as taught by Dawson. Dawson 
discloses the pixel texture value is modified during perspective transformation (Figure 4 
26 where pixel color is filtered & interpolated). 

Thus, it would have been obvious to one of ordinary skill in the art at the time the 
invention was made to incorporate the teaching of Dawson into Oles because Oles 
discloses a method of generating a prototype image and Dawson discloses the image 
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texture can be texture mapped in perspective in order to enhance visual reality (column 

I, line 50). 

7. As per claim 2, Oles and Dawson demonstrated all the elements as applied to 
the rejected independent claim 1, supra, and Oles further discloses identifying a picture 
portion of the frame image (Figure 3 24). 

8. As per claim 3, Oles and Dawson demonstrated all the elements as applied to 
the rejected dependent claim 2, supra, and Oles further discloses identifying the picture 
portion of the frame image includes providing a mat identifying the picture portion of the 
frame image (Figure 3 24). 

9. As per claim 4, Oles and Dawson demonstrated all the elements as applied to 
the rejected dependent claim 3, supra, and Oles further discloses the mat includes a 
plurality of pixels, each pixel having a pixel value (since the display device is a computer 
display, it is inherent that the image is represented by a plurality of pixels). 

1 0. As per claim 5, Oles and Dawson demonstrated all the elements as applied to 
the rejected dependent claim 4, supra, and Oles further discloses wherein identifying 
the picture portion of the frame image includes setting each pixel in the mat that 
corresponds to the picture portion of the frame image to a first pixel value (since pixels 
values are used to represent a picture, the pixels are at certain values at any time). 

II. As per claim 6, Oles and Dawson demonstrated all the elements as applied to 
the rejected dependent claim 2, supra, and oles further discloses wherein identifying the 
picture portion of the frame image includes identifying the outer perimeter of the picture 
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portion of the frame image (Figure 2 when a picture is selected, its picture and frame 
are identified). 

12. As per claim 7, Oles and Dawson demonstrated all the elements as applied to 
the rejected independent claim 1, supra, and Oles further discloses wherein the picture 
portion of the frame image has a quadrilateral shape and the method further includes 
identifying the picture portion of the frame image including identifying the four comers of 
the picture portion (Figure 2 shows the picture is quadrilateral shape and since the 
picture is movable, its four corners are indentified). 

1 3. As per claim 8, Oles and Dawson demonstrated all the elements as applied to 
the rejected independent claim 1, supra, and Oles further discloses displaying the frame 
prototype image (Figure 4 26). 

1 4. As per claim 9, Oles and Dawson demonstrated all the elements as applied to 
the rejected independent claim 1, supra. 

Oles and Dawson disclose a method of generating a in perspective frame 
prototype image, it is noted that Oles and Dawson do not explicitly disclose "mapping 
the picture image to the picture portion of the frame image includes texture mapping the 
picture image to the picture portion of the frame image", however, Since both the frame 
image texture and picture image texture are both image texture, it would have been 
obvious to one of ordinary skill in the art to map frame prototype image texture to 
perspective frame prototype image texture and picture prototype image texture to 
perspective picture image texture in order to perform proper transformation. 
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15. As per claim 1 1 , Oles and Dawson demonstrated all the elements as applied to 
the rejected independent claim 1, supra, and Oles further discloses the frame image is 
captured using a digital camera (Figure 1 50 the CCD connected to 54 the computer). 

16. As per claim 12, Oles discloses a computer program product tangibly embodied 
in a computer-readable medium, for generating a frame prototype image showing a 
picture image framed within a frame, comprising instructions operable to cause a 
computer to: 

receive the picture image (Figure 1 50 to 54); 

store a frame image showing the frame in a perspective view and a mat 
identifying the picture portion of the frame image (Figure 4 26; since Figure 1 54 is a 
computer, it can store image); and 

map the picture image to the picture portion of the frame image in order to 
generate the frame prototype image (Figure 4 26 to Figure 5 26). 

Oles discloses a method of generating a frame prototype image. It is noted that 
Oles does not explicitly disclose using texture mapping the picture image of the frame 
image to generate the frame prototype image, however, this is known in the art as 
taught by Dawson et al., hereinafter Dawson. Dawson discloses a method of providing a 
texture mapped perspective view for digital map systems (column 2, line 61-62, since 
the digital map is a prototype image). 

It is further noted that Oles does not explicitly disclose "modifying a texture value 
at a pixel by the original pixel value of the picture image to generate the frame prototype 
image", however, however, this is also known in the art as taught by Dawson. Dawson 
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discloses the pixel texture value is modified during perspective transformation (Figure 4 
26 where pixel color is filtered & interpolated). 

Thus, it would have been obvious to one of ordinary skill in the art at the time the 
invention was made to incorporate the teaching of Dawson into Oles because Oles 
discloses a method of generating a prototype image and Dawson discloses the image 
texture can be texture mapped in perspective in order to enhance visual reality (column 
1, line 50). 

17. As per claim 13, Oles and Dawson demonstrated all the elements as applied to 
the rejected independent claim 12, supra, and Oles further discloses instructions 
operable to cause the computer to generate the map (Figure 4 26 to Figure 5 26; since 
Figure 1 54 is a computer, it can contain instructions to generate the map). 

18. As per claim 14, Oles and Dawson demonstrated all the elements as applied to 
the rejected dependent claim 13, supra, and Oles further discloses instructions operable 
to cause the computer to generate the map by identifying the picture portion of the 
frame image (Figure 4 24). 

19. As per claim 15, Oles and Dawson demonstrated all the elements as applied to 
the rejected dependent claim 12, supra, and Oles further discloses instructions operable 
to cause the computer to identify the picture portion of the frame image by identifying 
the outer perimeter of the picture portion of the frame image (Figure 2 when a picture is 
selected, its picture and frame are identified). 

20. As per claim 17, Oles discloses a method of generating a visual representation of 
an image based product, the method comprising: 
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providing an image to be included in the image based product (Figure 4); 

providing a perspective image showing the image based product in a perspective 
view, the perspective image having a picture portion corresponding to the portion of the 
image based product used to view a picture mounted on the image based product 
(Figure 4 26 to Figure 5 26); and 

mapping the image to the picture portion of the perspective image in order to 
generate the perspective prototype image (Figure 4 24 to Figure 5 24). 

Oles discloses a method of generating a frame prototype image. It is noted that 
Oles does not explicitly disclose using texture mapping the picture image of the frame 
image to generate the frame prototype image, however, this is known in the art as 
taught by Dawson et al., hereinafter Dawson. Dawson discloses a method of providing a 
texture mapped perspective view for digital map systems (column 2, line 61-62, since 
the digital map is a prototype image). 

It is further noted that Oles does not explicitly disclose "modifying a texture value 
at a pixel by the original pixel value of the picture image to generate the frame prototype 
image", however, however, this is also known in the art as taught by Dawson. Dawson 
discloses the pixel texture value is modified during perspective transformation (Figure 4 
26 where pixel color is filtered & interpolated). 

Thus, it would have been obvious to one of ordinary skill in the art at the time the 
invention was made to incorporate the teaching of Dawson into Oles because Oles 
discloses a method of generating a prototype image and Dawson discloses the image 
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texture can be texture mapped in perspective in order to enhance visual reality (column 
1, line 50). 

21 . As per claim 18 f Oles and Dawson demonstrated all the elements as applied to 
the rejected independent claim 17, supra, and Oles further discloses the image based 
product is a framed picture (Figure 4 24). 

22. As per claim 19, Oles and Dawson demonstrated all the elements as applied to 
the rejected independent claim 17, supra, and Oles further discloses the image based 
product is a Photocard (since the image is a photo image). 

23. As per claim 21 , Oles and Dawson demonstrated all the elements as applied to 
the rejected dependent claim 20, supra, and Oles further discloses the method includes 
displaying the perspective image in an environment that provides a context for viewing 
the image based product (Figure 4). 

24. Claim 10 is rejected under 35 U.S.C. 103(a) as being unpatentable over Oles 
(6,047,130) and Dawson as applied to claim 1 above, and further in view of Kurashige 
(5,282,262). 

As per claim 10, Oles and Dawson demonstrated all the elements as applied to 
the rejected independent claim 1, supra. 

Oles and Dawson disclose a system of generating a frame prototype image. It is 
noted that Oles and Dawson do not explicitly disclose "mapping the picture image to the 
picture portion of the frame image includes mapping the picture image to the picture 
portion of the frame image using the illumination of the picture portion of the frame 
image", however, this is known in the art as taught by Kurashige. Kurashige discloses a 
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method of transforming a two-dimensional image by illumination on a three-surface 
(Figure 4A-4B). 

Thus, it would have been obvious to one of ordinary skill in the art at the time the 
invention was made to incorporate the teaching of Kurashige into Oles and Dawson 
because Oles and Dawson disclose a system of generating a frame prototype image 
and Kurashige discloses mapping an image into an illuminated region in order to make 
the image more realistic. 

25. Claim 1 6 is rejected under 35 U.S.C. 1 03(a) as being unpatentable over Oberg 
(5,870,771 ) in view of Oles (6,047,130), and further in view of Dawson et al. 
(5,179,638). 

As per claim 1 6, Oberg discloses a system for generating a frame prototype 
image showing a picture image framed within a frame, the system comprising: 

a client computer in communication with a computer network (Figure 3 70); 

a server, in communication with a computer network, having server software 
embodied in a computer-readable medium, the server software comprising instructions 
operable to cause the server to: 

receive the picture image from the client computer (Figure 3 72); 

wherein the client computer includes client software embodied in a computer 
readable medium, the client software comprising instructions operable to cause the 
client computer to upload the picture image to the server ("a customer can input a digital 
image of an object to be framed to the system through a digital camera 32", column 5, 
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line 64-66. Thus, it is inherent that the digital camera has the desired software to upload 
the picture image to the server). 

Oberg discloses a system of generating a frame prototype image. It is noted that 
Oberg does not explicitly disclose "store a frame image showing the frame in a 
perspective view and a mat identifying the picture portion of the frame image; and map 
the picture image to the picture portion of the frame image in order to generate the 
frame prototype image", however, this is known in the art as taught by Oles. Oles 
discloses a computer to generating a portrait photograph in which a frame and the 
picture in it are transformed into perspective view (Figure 4 24 and 26 to Figure 5 24 
and 26). 

Thus, it would have been obvious to one of ordinary skill in the art at the time the 
invention was made to incorporate the teaching of Oles into Oberg because Oberg 
discloses a system of generating a frame prototype image and Oles discloses a method 
of putting the picture in perspective in order to visually determine the appropriate size of 
a portrait photograph (column 2, line 4). 

Oberg and Oles disclose a method of generating a frame prototype image. It is 
further noted that Oberg and Oles do not explicitly disclose using texture mapping to 
map the picture image, however, this is known in the art as taught by Dawson. Dawson 
discloses a method of providing a texture mapped perspective view for digital map 
systems, column 2, line 61-62. 

Thus, it would have been obvious to one of ordinary skill in the art at the time the 
invention was made to incorporate the teaching of Dawson into Oberg and Oles 
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because Oberg and Oles discloses a method of generating a prototype image and 
Dawson discloses the image can be texture mapped in perspective in order to enhance 
visual reality (column 1, line 50). 

26. Claim 20 is rejected under 35 U.S.C. 103(a) as being unpatentable over Oles 
and Dawson et al. as applied to claim 17 above, and further in view of Oberg. 

Oles discloses a computer to generating a frame prototype image in perspective. 
It is noted that Oles and Dawson do not explicitly disclose the image based product is a 
photo greeting card, however, this is known in the art as taught by Oberg. Oberg 
discloses a system to generating a portrait photograph which is a photo greeting card. 

Thus, it would have been obvious to one of ordinary skill in the art at the time the 
invention was made to incorporate the teaching of Oberg into Oles and Dawson 
because Oles and Dawson disclose a system of generating an image in perspective 
and Oberg discloses the image can be made into a portrait photograph in order to make 
immediate use (column 2, line 4). 

Response to Arguments 

27. Applicant's arguments filed 4/5/2004 have been fully considered but they are not 
persuasive. 

Applicant alleges Oles only use "size perspective" for video image, therefore, 
Oles does not meet claims 1, 12, 16 and 17 "perspective" limitations. In reply, examiner 
note since applicant admits "size perspective" is a form of perspective, it meets the 
claim limitation. However, examiner further consider the disclosure "The present 
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invention as depicted in Fig. 5 allows the customer or operator to change the 
perspective of the video image (and the size of the resulting portrait) as well as move 
and position the combined image within the simulated room setting image" (column 5, 
line 30-35). Since Oles specifically points out "(and the size of the resulting) as well as 
move and position the combined image" are additional conditions of perspective view 
and since the two variables (size and position) are the only variable allowed to change 
in a head-on view image, Oles implies a perspective image means more than a head-on 
view. Therefore, a perspective view includes angle view. 

Conclusion 

28. Any inquiry concerning this communication or earlier communications from the 
examiner should be directed to Ryan Yang whose telephone number is (703) 308- 
6133. 

If attempts to reach the examiner by telephone are unsuccessful, the examiner's 
supervisor, Michael Razavi, can be reached at (703) 305-4713. 

Any response to this action should be mailed to: 

Commissioner of Patents and Trademarks 
Washington, D.C. 20231 

or faxed to: 

(703) 872-9314 (for Technology Center 2600 only) 
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Hand-delivered responses should be brought to Crystal Park II, 2121 Crystal 
Drive, Arlington, VA, Sixth Floor (Receptionist). 

Any inquiry of a general nature or relating to the status of this application or 
proceeding should be directed to the Technology Center 2600 Customer Service Office 
whose telephone number is (703) 305-47000377. 




Ryan Yang 
June 13, 2004 



